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Abstract 



Semantic Nets 



This paper describes the implementation of a semantic interpreter 
for a transportable command language interface that accepts 
natural language input Included in the discussion are the theories 
of representation for semantic knowledge that influenced the 
implementation and a functional description of the interpreter. 



Introduction 

Semantic interpretation is the process of generating a structure 
that represents ihe meaning of a sentence! 19]. The computer 
can be said to "understand" the structure if it can incorporate 
a declarative sentence into its database and use it for future 
inference, or perform a requested action for a command, or make 
an appropriate reply to a question. The generated structure must 
therefore conform to an internal representation that may be used to 
bring about these actions. The operation of a semantic interpreter 
is based on two underlying assumptions: 1) that syntax is an 
encoding of meaning and 2) that the meaning of the whole (i.e., 
the sentence ) is the sum of the meaning of its parts. The latter 
assumption is called compositionalityf 1]. 

Three theories of representation for semantic knowledge have 
influenced the design of the semantic interpreter. They are 
semantic nets by Quillian[l], conceptual dependency by Roger 
Schank[30], and conceptual graphs by John Sowa[35]. A brief 
overview of each formalism and a discussion of their combined 
influence on the semantic interpreter is presented below. 



Semantic nets[l][37] were first proposed as a model of human 
cognition in keeping with the school of AI theorists who believe 
that computers would become intelligent by doing things the way 
humans do them. 

Semantic nets arc graphically represented as nodes connected by 
arcs. Both the nodes and the arcs are labeled. Traditionally, the 
nodes represent objects and the arcs represent the relationships 
between the objects. The labels are not standardized and may 
be designed by the user depending on the information to be 
represented. 

Figure 1 is a representation of the statement "Diane is a mother." 



DIANE 



ISA 



MOTHER 



Figure 1 Semantic Network A 

The major advantage of semantic nets is the ability of subclasses to 
inherit qualities from superclasses! 1]. Figure 2 shows an example. 



MOTHER 



ISA 



DIANE 



ISA 



FEMALE 



ISA 



LESLIE 



Figure 2 Semantic Network B 
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The fact thai a mother is female is succinctly captured. Diane 
and Leslie inherit female-ness from their superclass "MOTHER." 
A system whose database contained the above fact, could 
affirmatively answer the query "Is Leslie female" by following 
the ISA links. 
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A problem with semantic nets is the difficulty in distinguishing 
between individuals and the class to which they belong when 
dealing with inheritance. 



ISA 


PRIMATE 


STUDIED- BY 


JANE GOODALL 







Deliyanni[ll) defines an extended version of semantic nets that 
gives them the expressive power of predicate logic and can also be 
used as an abstract data structure. In Deliyanni's formalism, terms 
are represented by nodes, binary predicates are arc labels and an 
atom consists of an arc and its two end nodes. The arc direction 
gives the order of the arguments of the predicates. Figure 5 below 
shows the extended semantic net representing that every person 
is either male or female. 



Figure 3 Semantic Network C 

In figure 3, a gorilla is a primate, and Jane Goodall studies 
primates. Bob, however, is a specific gorilla and therefore also a 
primate, but he may not be a subject of study by Jane Goodall. 

A solution to this problem is to differentiate between concepts 
and instances of a concept. Links from a concept should be 
true for that concept and validly inheritable by all instances of 
that concept Links from an instance of a concept are used to 
describe qualities specific to the individual. A better version of 
the previous example is given in figure 4. 



Single trrowi represent condition*. The double arrow represents the 
contusion that miy be drawn if the condition is true. 




Figure 5 Extended Semantic Net 
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Figure 4 Semantic Network D 

The combination of two nodes and their intervening link 
is clearly another representation of binary predicates, e.g., 
ISA(BOB.GORILLA). 

One of the earliest examples of the use of a version of semantic 
nets in an understanding system was SIR: Semantic Information 
Retrieval by Bertram Raphael[l] in which "understanding** was 
demonstrated by the computer enganging in conversations that 
required awareness of the meaning of the topic. Raphael used 
binary predicates like part_of(finger,hand) and the attributes subset 
and superset 

More recently YUCCA II, a UNIX consultation facility! 18] has 
made use of an object database using a generalized hierarchy with 
property inheritance and distinction between individual instances 
and object classes. 



Conceptual Dependency 



Roger Schank[l][37] introduced the idea of conceptual 
dependency. Conceptual dependency is a representation based on 
semantic primitives. Schank believes that for a given concept the 
representation should be unique and unambiguous. Notice that we 
are dealing with concepts not sentences. The idea of uniqueness 
of a concept goes much farther that recognizing the relationship 
between passive and active statements of the same thought. All of 
the sentences given below should have the same representation. 



He owns that car. 
That car is his. 
That car belongs to him. 
He is the owner of that car. 



Schank associates this sameness of representation with the human 
ability to paraphrase. 

Schank defined a number of primitive acts, such as the now 
familiar ATRANS and FTRANS, which were intended to be used 
as building blocks for concept representation. 

Conceptual dependency has two advantages over semantic nets as 
a knowledge representation: 

1. The primitive acts themselves represent several inferences. 

2. Fewer rules are needed. 
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An example is the conceptual dependency representation of "The 
gorilla ate the banana." 

Gorilla « P fr INGEST ^ c P* ovcr double arrow indicates past 

t tense and the V between banana and 

o INGEST indicates thai banana is the object 

banana of the primitive act. 

Figure 6 The INGEST primitive 

By the definition of the INGEST primitive we may infer that the 
location of the banana is now inside the gorilla and that the banana 
no longer exists outside of the gorilla. A rule-based system would 
require three explicit rules to represent the concepts captured by 
this single primitive. 

Schank developed a system called MARGIE to implement his 
theories about conceptual dependency [1]. 

Conceptual Graphs 



Conceptual Graphs are a representation formalism for information 
about things and events as well as semantic information. They 
were introduced by John Sowa(36][35]. 

A conceptual graph contains three types of objects: concept types, 
conceptual relations and referents. A concept is constrained to a 
particular value by assigning a referent 

[CITY: {Ruston, Louisiana)] 

In the above example CITY is a concept whose referent is Ruston, 
Louisiana. Concepts are linked by conceptual relations to form 
conceptual graphs. In figure 7, Bob the gorilla is the agent of the 
action concept "ATE" and the concept "BANANA" is the object 



[ GORILLA: *Bob*>< 



AGT 



-4ATE]- 



OBJ 



-4BANANA] 



Figure 7 Conceptual graph of "Bob the gorilla ate the banana" 

The rules of formation for conceptual graphs are syntactic[12]. 
Concept types may be assigned attributes using the relationship 
"<" Thus GORILLA < PRIMATE assigns to all instances of 
GORILLA the attribute of PRIMATE. This allows us to infer 
that Bob from the previous example is a primate. Several 
algorithmic operations are defined on conceptual graphs such as 
join, contraction, and matching. Conceptual Graphs obey the 
theory of compositional! ty and also allow inference. 

Sowa has implemented a semantic interpreter using conceptual 
graphs based on the following algorithm[36]: 

1. Look up each word in a lexicon of graphs that represent the 
ways concepts and relations can be linked. 

2. Build the representation of the input sentence by joining the 
graphs for each word in the sentence. 



The syntactic parse tree that is the input to the semantic interpreter 
guides the joining of the graphs. Syntactic ambiguities are 
resolved because the semantic information stored in the graphs 
rejects illegal joins. 

Influences on the Design of the Semantic Interpreter 

During the development of the semantic interpreter, each word was 
initially assigned to a category, for example, ACTION(FORMAT), 
OBJECT(DISK). This method required a process by which the two 
would be linked to show a valid concept, and equally as important, 
a method of determining which concepts were not valid. The 
knowledge base might also contain the entries OBJECT(FILES), 
ACnON(UST). A representation capable of showing that FILES 
is a valid object of LIST but not of FORMAT, while DISK 
is a valid object for both, was needed. Referring to Schank's 
theory that each concept should have a unique and unambiguous 
representation, it was deemed desirable to use a representation 
similar to Schanks primitives, while maintaining the readability 
of semantic nets. The classic primitives as defined by Schank are 
singularly unsuited to use over the application domain. I decided 
to take the clausal representation of semantic nets, to collapse it, 
and to combine related categories into primitives. These primitives 
were then used as cases during syntactic parsing. Using the four 
words given above: LIST, FORMAT, DISK, and FILES, their 
relationship can be captured by the semantic net shown in figure 
8. 




Figure 8 Clausal form of a Semantic Network 
Representing the same information in clausal form we have 



IS A (FORM AT, V ERB ) 

ISA(UST.VERB) 

ISA(DISK^OUN) 

ISA(FILES.NOUN) 

OBJECT_OF(FILES,LIST) 

OBJECT_OF(DISK,UST) 

OBJECT_OF(DISIU ; ORMAT) 

Collapsing the predicates creates 



VERB(FORMAT) 

VERB(UST) 

NOUN(DISK) 
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NOUN(FILES) 
OBJECT_OF(FILES,UST) 
OBJECT_OF(DISK,USnr) 
OBJECT_OF(DISK.FORMAT) 

By combining the predicate we derive 

VERB_OBJ(UST,FILES) 
VERB_OBJ(UST.DISK) 
VERB_OBJ(FORMAT.DISK) 

The verb_obj primitive represents that its first argument is a verb 
and its second argument is a value which is a valid object of the 
verb's action. In the implementation I have renamed the verb_obj 
primitive to actjobj. 

The semantic knowledgebase is composed of all possible valid 
relationships between the words which are recognized by the 
syntactic parser. The relationships are described by cases. 

The algorithm by which the semantic interpreter performs its 
function is based on Sowa's conceptual graphs theory. Sowa 
has implemented a semantic interpreter by joining graphs of word 
meaning to create a structure that captures a concept. The semantic 
interpreter of this project operates on the same theory. The parse 
that is sent to the semantic interpreter by the syntactic parser 
is a list of cases. These cases are a clausal representation of 
graphs. The cases, when combined, form a representation of the 
meaning of the sentence that is a composite of the meaning of the 
individual cases. The Semantic Interpreter checks each case for 
semantic correctness. If all the cases that represent a sentence are 
correct, then the concept expressed by the sentence is semantic ally 
valid. For example, the sentence "list all files** will generate the 
following case representation. 

action("list") 
act_objC'list", "files") 
adj("alP) 

This sentence is semantically correct if the semantic database 
contains an entry that matches each case. 

Implementation of the Semantic Interpreter 

The semantic interpreter (SI) accepts the output of a syntactic 
parser and determines if it makes sense. The most important 
feature of the SI is its domain specificity. The sentence "TEIX 
THE TRUTH" is well formed and meaningful in the real world 
but makes no sense in the microworld of command languages. 
When I speak of "making sense" with respect to the SI, I mean 
that the input is meaningful over the application domain. 

The SI has two parts, the lexicon, which contains domain specific 
information about the concepts represented by words and the 
roles that those words may play in a "correct" sentence, and the 
interpreter proper. 



The interpreter moves through the structure generated by the 
parser and for each element in that structure, determines if it 
is conceptually correct by referring to the lexicon. The sentence 
will already have been checked for syntactic correctness, so the 
interpreter is only checking for semantic correctness. 

The output of the interpreter will be the same structure as was 
passed to it by the parser if thai structure is determined to be 
correct or a flag indicating no correct parses. 

Functional Description 

The semantic interpreter is implemented in keeping with the 
cognitive theory that humans understand infinitely many different 
sentences because we parse them syntactically and derive the 
meaning of the sentence from the combined meaning of its parts. 

The semantic interpreter (SI) is called by an interface driver with 
no parameters. The parse(s) which are passed to the interpreter 
are generated by an ATN parser . Each parse consists of a list 
of cases that describe the relationship of the words in the input 
sentence. The SI recursively removes each case from the list and 
checks its validity. A case, representing some portion of the input 
sentence is valid if it corresponds to an entry in the database or if 
it fits a predefined pattern. A sentence is semantically correct if 
all the case structures of which its representation are composed, 
are valid. 

Patterns are used for situations in which user defined names 
may be encountered. For example "CHANGE DIRECTORY TO 
C:\USR\PROCESS." It is not possible to predict the names which 
users will assign to their directories and/or files, nor is is possible 
to place any such entry into the semantic knowledgebase. This 
difficulty has been s loved by using pattern matching. For the 
example given above, the following predicate constitutes a pattern 
by which the preposition 'TO** and its object "C:\USR\PROCESS" 
may be recognized as semantically correct. 

is-pattem(X):- 
X = (prep.objCno-Z)), 
part_speech(Z,paihname,Z). 

A tokenizex/preprocessor is used to determine that C:\USR\PROCESS 
is a pathname and to assert a fact to that effect into the database. 

As an example of the operation of the SI assume that we have, 
in the knowledgebase for the semantic interpreter, the following 
entries: 

ACT_OBJ(FORMAT,DISK) 
ACT_OBJ(LIST,FILES) 
MODT(THE) 
MODT(ALL) 
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As input to the command language interface we give "format 
the files" which will be transformed by the syntactic parser to 
[act_obj(form affiles) .modt(the)]. This request is not semantically 
valid because "files" is not a valid receiver of the action of the 
verb "format." The in appropriateness of the request is indicated 
by the absence of an [act_obj( form at, files)] entry in the database. 
Alternatively, "list all files" and "format the disk" are valid 
semantic requests. 



Differences In My Approach 

In previous implementations of semantic interpreters, the approach 
has been to take the syntactic parse tree, which consisted solely 
of the parts of speech of the words in the sentence, and to try 
to assign meaning to the order of the words. The system that 
I have designed deviates from this approach in that the parse 
tree produced by the syntactic parser is itself a representation of 
sentence meaning. Moreover, I have based this implementation 
on two significant assumptions: 

1 . That over a well bounded domain, it is possible to determine 
the underlying meaning of a sentence through syntactic 
analysis. If this is true, from syntax alone it should be 
possible to derive a valid representation of sentence meaning. 
By concept, I mean the underlying idea of a sentence rather 
than the actual content. For example, Given the sentence 
"List the files", the concept is that an action is to be 
performed on some object The content of the sentence 
gives definition to the action and its object. Using the 
concept of the sentence, a semantic representation can be 
built by filling in the "content" over the structure of the 
concept. The concept is 



ACnON(X) 
OBJECT(Y) 

Filling in the content. X = UST and Y = FILES. Combining 
the two into a valid case gives ACT_OBJ("LiST\"FILES") 
which represents the meaning of the sentence. 
2. Perhaps we perceive the world as a set of microworlds. 
Each thing considered in its proper context is the basis for 
understanding. 

Additionally, the SI which I have implemented differs from other 
systems in the following two ways: 

1 . No manipulation of the syntactic parse tree is required to 
determine semantic validity. 

2. Previous systems have allowed the ad-hoc creation of 
database objects to compensate for unpredictable events. I 
have used patterns. 

Summary 

The semantic interpreter for the transportable command language 
interface was implemented based on Schanks theory that sentences 
expressing the same concept should have the same representation. 
The SI incorporates three key ideas: 

1. The use of binary predicates to represent semantically valid 
relationships. 

2. The use of case structures for both syntactic and semantic 
analysis based on the assumption thai over a well bounded 
domain sentence structure is a valid indicator of the concept 
represented by the sentence. 

3. The use of generic patters for word/concepts not "known" 
by the system. 
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ABSTRACT 

In this paper, the confidence measure of a hypothesized word 
is derived from its posterior probability. In contrast to common ap- 
proaches, in which N-bcst lists or word graphs/lattices are used, the 
posterior probabilities are derived from a concept graph. The con- 
cept graph is obtained from a word graph through a partial parsing 
process using semantic grammars. This approach allows us to use 
relatively complex and better language models along with acous- 
tic models to compute word posterior probabilities. The language 
model used is comprised of stochastic context free grammars ( one 
for each concept) and an n-gram concept language model. We 
show that the posterior probabilities computed on concept graphs 
outperform those computed on word graphs when used as confi- 
dence measures. Results are presented within the context of Col- 
orado University (CU) Communicator System; a telephone-based 
dialog system for making travel plans by accessing information 
about flights, hotels and car rentals. 

1. INTRODUCTION 

In several tasks the output of the speech recognizer is far from 
perfect This creates problems in applications that use the tran- 
scription directly. For instance, in a dialog system, errors in the 
output word sequence can lead to a dialog flow that diverges from 
the user's goal. This results in a longer, or maybe unsuccessful, di- 
alog leaving the user confused, frustrated and dissatisfied with the 
interaction. So, it is very important for a dialog manager to spot 
incorrectly recognized words and act accordingly to achive human- 
like performance. Another example is the unsupervised adaptation 
of the acoustic models using maximum likelihood linear regres- 
sion (MLLR). Adaptation with an incorrect transcription degrades 
the performance. Therefore, one needs a method to spot incorrect 
words and exclude them from adaptation. 

Confidence measures are used to label the words at the out- 
put of the speech recognizer as correct or incorrect. The basic 
approach is to select a set of effective features and find a way of 
combining them into a confidence measure [t, 2, 3]. Although 
the combination of several features improves the performance, it is 
usually not much better than that of the best feature. 

The word posterior probabilities have been proposed and used 
as a confidence measure or as an additional feature [4, 5, 6). The 
utility of the word posterior probabilities for confidence annotation 

The work is supported by DARPA through SPAWAR under grant 
#N66001-00-2-S906. 



has been clearly illustrated in [7]. Those probabilites were calcu- 
lated using either N-best lists or word graphs/lattices. The knowl- 
edge sources were acoustic models and n-gram language models. 
Recently, in dialog systems, it has been observed that additional 
features at higher levels, e.g. parsing or understanding levels, im- 
prove the performance significantly [8, 9] . 

In this paper, we incorporate knowledge at the understanding 
level as a statistical language model (SLM). The SLM has been de- 
veloped within a flexible speech understanding framework [10]. It 
consists of a set of stochastic context free grammars, one for each 
concept, and dialog context conditioned digram concept LMs. We 
use SCFGs to parse the word graph into a concept graph. Then, 
we compute word posterior probabilities on the concept graph us- 
ing acoustic models, SCFGs, and concept trigram LMs interpo- 
lated with word/class based trigram LM. We compare a confidence 
measure computed on concept graphs to that computed on word 
graphs. We provide results that show the better performance of the 
concept graph based confidence measure. 

The paper is organized as follows. In section 2, we summa- 
rize the posterior probability computation on word graphs using 
the forward/backward algorithm The extension of this method to 
concept graphs is explained in section 3. The experimental setup 
and results are presented in section 4. The last section includes 
concluding remarks and possible future work. 



2. WORD PROBABILITIES ON WORD GRAPHS 

In this section, we present a forward/backward type algorithm for 
calculating the word probabilities on word graphs similar to that 
presented in [7]. Let s be the start frame and e be the end frame of 
a word w in a sequence of words that spans a time interval of 
length T frames. We define a word event as [u/ t a,e]. We are inter- 
ested in the probability of this event given the acoustic observation 
oj. This probability should be calculated over all possible word 
sequences that contain w at the interval [s, e]. However, it is a 
common practice to restrict the computation to a word graph, as it 
is a compact representation of the most probable word sequences. 

We first explain the word graph generated by the speech rec- 
ognizer (CMU-Sphinx II [11]). It is a directed weighted acyclic 
graph. It is built from the word lattice created during frame syn- 
chronous tree lexicon Viterbi beam search. Its nodes represent 
unique (w, s) pairs. Edges are labeled with end frames and acous- 
tic model scores, p(of/w). They point to nodes (e + where 
e is the end frame of the word w and w s is its successor. Note that 
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each unique node can link to more than one node, thanks to the 
possibility of more than one end time and successor of a particular 
word that starts at frame a. Each path through the word graph is a 
word sequence that spans the time interval of length T. The set of 
all paths defines the ensemble on which we calculate the posterior 
probabilities. 

Each word event [tu.a.e] corresponds to a set of edges in 
the word graph. So, the probability of a word event is the total 
probability of all edges associated with it. In developing the for- 
ward/backward type algorithm, we consider the edges as HMM 
like states . The emission probabilities are the acoustic scores kept 
at the edges. The transition probabilities are provided by the lan- 
guage model in use, which is assumed to be a word based digram 
LM in the sequel. Its extension to a class-based trigram LM is 
straightforward. To derive the algorithm we need to define edges 
uniquely. So, the edge from node (ut£, a) to (ti^+i , «+ 1) is defined 

as Bt»{J 1,e+1 . We define the forward probability of an edge as 

°C £ S{J I,C+1 )- "H* following recursion can be used to compute 
the forward probabilities: 

«(<;y e+1 )=^si«» j ). E 

■%+iK-i.«i) 
(l) 

Similarly, we define the backward probability of an edge as 
/J(£jj£^ 1,<+1 ). The recursion for the backward probabilities is 

(2) 

Once we have computed the forward-backward probabilities 
we can calculate the edge posterior probabilities, and in rum, the 
word posteriors. The posterior probability of an edge can be ob- 
tained as 



PK b w it a ) - 



^y- e+I )^(<y e+1 ) 



(3) 



where p{oJ) can be obtained as the summation of the forward 
probabilities of the edges that end at frame T. Equivalently, it 
can be calculated as the summation of the backward probabilities 
of the edges that start at the initial frame. 

In fact, the probability in (3) is the posterior probability of 
the word that starts at frame s, ends at frame c and precedes the 
word t^+i- In [7], it has been demonstrated that the use of this 
probability as a confidence measure on a hypothesized word does 
not give satisfactory results. Instead, we use 



(4) 



This amounts to the summation of the probabilities of the 
edges outgoing from node (u^,a). For other possibilities of con- 
fidence measures derived from posterior probabilities the reader is 
referred to [7]. 




Fig. 1. (a) word graph ,(b) concept graph 



3. CONCEPT/WORD PROBABILITIES ON CONCEPT 
GRAPHS 

The structure of the concept graph is same as the word graph. The 
nodes are associated with (c, a) pairs. The concept c can span a 
number of words. An example of a concept graph derived from 
a word graph by partial parsing using a semantic grammar is de- 
picted in Figure I. 

The concepts are classes of phrases with the same meaning. 
That is, a concept class is a set of phrases that can be used to ex- 
press that concept (e.g. [date], [yes]). Each concept (except degen- 
erate single word concepts) is written as a context free grammar 
(CFG) and compiled into a recursive transition network (KTN). 
The arcs of RTNs are populated with probabilities using a training 
method based on simple counting and smoothing. So, the multi- 
plication of the arc probabilities that traverse a phrase gives the 
probability of that phrase. The concept patterns are modeled by n- 
gram LMs conditioned on the dialog context The dialog context 
has been taken as the system's last prompt A detailed discussion 
of these LMs can be found in [10]. 

Simitar to the word event defined in the preceding section, we 
define a concept event, [c, a, e], which can also be associated with 
a set of edges outgoing from node (c,s). Here, the start frame is 
the start frame of the the first word and the end frame is the end 
frame of the last word covered by the concept On each edge, we 
have an acoustic score , which is the multiplication of the acoustic 
scores of the words spanned by the concept, and the phrase prob- 
ability (determined from the concept's SCFG) . One can compute 
the concept posterior probabilities using the forward backward al- 
gorithm described above. On a concept graph, the ernmision prob- 
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ability is the acoustic probability multiplied by the phrase proba- 
bility. The transition probabilities are computed using the trigram 
concept LM. The corresponding forward backward equations are 

•Psfe+ll^-l^) ( 5 ) 



where P5(.) is the probability conditioned on the dialog context, 
denoted by S, 



(8) 



= rif=iP( o fl{i a; i,i)p( r < I // c t) 

, ij =5, e^. = e, »•{ ; is the arc of q's RTN labeled by the word 
w i i and uij wj £ . is the £,-word phrase covered by the con- 
cept q. 

For the sake of simplicity we excluded two things in the 
derivation of the forward/backward expressions. One is the down- 
scaling of acoustic scores and the other is the interpolation of 
concept-based SLM with a word/class based SLM. The former is 
required due to the fact that acoustic scores and LM probabilities 
have entirely different dynamic ranges. To avoid the domination 
of summations by a small number of terms, the downscaling of 
the acoustic scores has been found very useful [7]. Our observa- 
tions during experiments were on the same line. The interpolation 
is required to take the advantage of the complementary nature of 
two different SLMs. It is possible that the interpolation partially 
recovers the loss from context free assumption. The interpolation 
is performed at the concept/phrase level. That is, the term 



PK,1> " * -> w i>LiW • P5( c sl c i-2» c i-l) 
in the expressions above is replaced by 



(9) 



(10) 

where w i 0 and w^-i are taken from preceding concepts. That 
is,u/ i(0 = andto^j = iv { _ hLi l _ v ifLi_i > 1. 

Otherwise, - ^i-2,L^ 2 ' ^ ote * e * nteI P 0 ' at ' on * s 

log-linear and A is the interpolation weight. This interpolation 
method is selected for two reasons. First, it is easier to imple- 
ment since the actual implementation deals with the logarithm of 
probabilities. Second, its performance has been found better than 
the linear interpolation [12, 13 J. 




Fig. 2. Relative CER improvement with respect to threshold 



Let C W{ be the set of concepts that include the word event 
[ujp 5, e]. Using the concept posteriors we calculate the confidence 
of it;; as 



p<^r +l ) 



do 



4. EXPERIMENTAL RESULTS 

We present experimental results on CU Communicator data. The 
CU communicator system is a dialog system used for flight, hotel 
and rental car reservations [14]. The data that we experimented 
with was collected during National Institute of Standards (NIST) 
2000 evaluation. It is from a total of 72 calls. The number of 
female and male callers are 44 and 28, respectively. A total of 1 264 
sentences were used in the experiments. Of these, 450 sentences 
were used to optimize scaling, interpolation factors and tagging 
thresholds. The final results are on the rest of the data. 

We used confidence error rates (CERs) and receiver operating 
characteristics (ROC) curves to evaluate the confidence measures. 
The CER is defined as 

QER — " lcorrect ^ y tagged words 
# recognized words 

The baseline CER is obtained assuming that all recognized 
words are tagged as correct This is equivalent to the summation 
of insertions and substitutions divided by the number of recog- 
nized words. The ROC curve is the plot of the correct rejection 
with respect to false rejection. The correct rejection is tagging the 
incorrect word as incorrect and the false rejection is tagging the 
correct word as incorrect. 

Figure 2 shows relative CER performance improvements over 
the baseline CER for both word graph and concept graph based 
word posteriors. It is plotted with respect to the threshold, as the 
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6. REFERENCES 



Fig. 3. Receiver operating characteristics (ROC) curve 



Table 1. CER and correct rejection (CR) results at 5% false 
rejection (FR) 



Method 


Baseline 


CER 


Reduction 


CR 


word graph 


14.4% 


11.8% 


18.1% 


48.9% 


concept graph 


11.9% 


8.8% 


26.1% 


63.2% 



CER strongly depends on the choice of the tagging threshold. The 
performances are compared relative to the baseline since two rec- 
ognizers have different operating points. Figure 3 shows the ROC 
curve. Both illustrate that the concept graph method performs bet- 
ter. 

Table 1. gives baseline CERs, the CERs after confidence an- 
notation, relative reduction in CERs and correct rejection (CR) re- 
sults at 5% false rejection (FR). AU figures clearly show the bet- 
ter performance of the confidence measure computed on concept 
graphs. 



5. CONCLUSIONS 

We have presented a confidence measure based on concept/word 
posterior probabilities computed on concept graphs. We have 
shown that it outperforms a similar confidence measure based on 
word graphs. We believe that the improvement is due to the in- 
corporation of higher level knowledge sources (syntactic and se- 
mantic constraints) into the computation of posterior probabilities. 
We plan to use this confidence measure for rescoring the concept 
graph to improve recognition performance. In addition, the use of 
this confidence measure in MLLR adaptation is worthy of future 
research. 
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Conceptual 



Conceptual graphs (CGs) are a system of logic based on the existential graphs of 
Charles Sanders Peirce and the semantic networks of artificial intelligence. They 
express meaning in a form that is logically precise, humanly readable, and 
computationally tractable. With a direct mapping to language, conceptual graphs 
serve as an intermediate language for translating computer-oriented formalisms to and 
from natural languages. With their graphic representation, they serve as a readable, 
but formal design and specification language. CGs have been implemented in a 
variety of projects for information retrieval, database design, expert systems, and 
natural language processing. 

For examples of conceptual graphs and their translations to predicate calculus and the 
Knowledge Interchange Format (KIF): 

© Examples using the standard HTML 4.0 symbol definitions 

^ Examples using the symbols font in MS Windows (suitable for older versions of 
Navigator or Internet Explorer). 

For the conceptual graph standard: 

new Working draft of the proposed ISO standard 

For a bibliography of books and conference proceedings about conceptual graphs: 
<g CG bibliography 

JFor links to other information about conceptual graphs, including conferences and 
tools: 

® CG home page at the University of Alabama at Hunstville 

To subscribe to the conceptual graph mailing list, send the following message to 
majordomo@cs.uah.edu. 



To : ma j ordomo@cs . uah . edu 



http://www.jfsowa.com/cg/ 
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Conceptual graphs are formally defined in an abstract syntax that is independent of any notation, but the 
formalism can be represented in several different concrete notations. This document illustrates CGs by 
means of examples represented in the graphical display form (DF), the formally defined conceptual 
graph interchange form (CGIF), and the compact, but readable linear form (LF). Every CG is 
represented in each of these three forms and is translated to a logically equivalent representation in 
predicate calculus and in the Knowledge Interchange Format (KIF) . For the formal definition of 
conceptual graphs and the various notations for representing them, see the draft proposed Am erican 
National Standard. For examples of an English-like notation for representing logic, see the web page on 
controUed English. 



List of Examples 

Following are some sample sentences that are represented in each of the notations: CGs, KIF, and 
predicate calculus. Click on the sentence to go directly to its representation. 

1 . A cat is on a mat. 



2. Every cat is on a mat. 



3. John is going to Boston by bus. 

4. A person is between a rock and a hard place. 

5. Tom believes that Mary wants to marry a sailor. 



l.A cutis on a mat. 

In the display form (DF), concepts are represented by rectangles; the concept [Cat] represents a instance 
of a cat, and [Mat] represents an instance of a mat. Conceptual relations are represented by circles or 
ovals: the conceptual relation (On) relates a cat to a mat. The arcs that link the relations to the concepts 
are represented by arrows: the first arc has an arrow pointing toward the relation, and the second arc has 
an arrow pointing away from the relation. If a relation has more than two arcs, the arcs are numbered. 




In the linear form (LF), concepts are represented by square brackets instead of boxes, and the conceptual 
relations are represented by parentheses instead of circles: 



[Cat]->(On)->[Mat] . 



http://www.jfsowa.com/cg/cgexamp.htm 
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Both DF and LF are designed for communication with humans or between humans and machines. For 
communication between machines, the conceptual graph interchange form (CGIF) has a syntax that uses 
coreference labels to represent the arcs: 

[Cat: *x] [Mat: *y] {On ?x ?y) 

The symbols *x and *y are called defining labels. The matching symbols ?x and ?y are the bound labels 
that indicate references to the same instance of a cat x or a mat y. To reduce the number of coreference 
labels, CGIF also permits concepts to be nested inside the relation nodes: 

(On [Cat] [Mat]) 

The display form in Figure 1 represents the abstract CG most directly. All the variations of LF and CGIF 
represent stylistically different, but logically equivalent ways of linearizing the same abstract graph. All 
these variations are accommodated by the LF grammar and the CGIF grammar, which are defined in the 
CG standard. 

CGIF is intended for transfer between computer systems that use CGs as their internal representation. 
For communication with systems that use other internal representations, CGIF can be translated to 
another logic-based formalism called the Knowledge Interchange Format (KIF): 

(exists ((?x Cat) (?y Mat)) (On ?x ?y) ) 

Although DF, LF, CGIF, and KIF look very different, their semantics is defined by the same logical 
foundations. They can all be translated to a statement of the following form in typed predicate calculus: 

( 3x:Cat) ( 3 y: Mat) on (x, y) . 

Any statement expressed in any one of these notations can be automatically translated to a logically 
equivalent statement in any of the others. Formatting and stylistic information, however, may be lost in 
translations between DF, LF, CGIF, KIF, and predicate calculus. 



2. Every cat is on a mat 

The default quantifier in a concept is the existential g, which is normally represented by a blank. The 
concept [Cat] without anything in the referent field is logically equivalent to the concept [Cat: g], which 
asserts the proposition that there exists a cat. Other quantifiers, such as the universal y, are called 
defined quantifiers because they can be defined in terms of conceptual graphs containing only the 
default existential. In Figure 2, the concept [Cat: y] represents the phrase every cat, and the complete 
CG represents the sentence Every cat is on a mat. 




h ttp : //www . j fso wa . com/cg/ cgexamp . htm 
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In the linear form (LF), the universal quantifier may be represented by the symbol y if it is available. 
Otherwise, it is represented by the symbol @every. Both of the following CGs are semantically 
identical: 

[Cat: V]->(On)->[Mat] . 
[Cat: @every] ->(On) ->[Mat] . 

Since CGIF is expressible in the 7-bit subset of ASCII or Unicode, the character y must be represented 
by @every in CGIF: 

[Cat: @every*x] [Mat: *y] (On ?x ?y) 

As in Figure 1, CGIF permits concepts to be nested inside the relation nodes: 

(On [Cat: @every] [Mat]) 

In all these examples, the universal quantifier @every or y includes the default existential quantifiers in 
the same context within its scope. The scope is enforced by the definition of the quantifier @every in 
terms of the existential. When the definition is expanded, the CG in Figure 2 is expanded to a CG that 
can be represented by the following LF graph: 

-[ [Cat: *x] 

-[ [?x]->(On)->[Mat] ] ] . 

Literally, this CG may be read It is false that there exists a cat x that is not on a mat. An alternate 
reading treats the two nested negations as an implication: If there exists a cat x, then x is on a mat. 
Following is a CGIF representation of the expanded CG: 

-[ [Cat: *x] -[ (On ?x [Mat] ) ]] . 

All of these forms are logically equivalent to the original CG in Figure 2. 

Since KIF has a universal quantifier, it is not necessary to expand the defined quantifier @every before 
translating a CG to KIF. Following is the KIF translation of Figure 2: 

(forall ((?x Cat)) (exists ((?y Mat)) (On ?x ?y) ) ) 

This KIF statement is logically equivalent to the KIF statement that results from translating the 
expanded CG: 

(not (exists (<?x Cat)) (not (exists {(?y Mat)) (On ?x ?y) ) ) ) ) 

The original CG in Figure 2 may be represented by the following formula in typed predicate calculus: 
( Vx:Cat) ( 3y:Mat)on(x,y) . 

This formula is logically equivalent to the formula that represents the expanded CG: 

-( 3x:Cat)~- ( 3 y : Mat ) on ( x, y) . 
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3. John is going to Boston by bus. 

Figure 3 shows a conceptual graph with four concepts: [Go], [Person: John], [City: Boston], and [Bus]. 
It has three concdeptual relations: (Agnt) relates [Go] to the agent John, (Dest) relates [Go] to the 
destination Boston, and (Inst) relates [Go] to the instrument bus. 




City: Boston 



Since the concept [Go] is attached to three conceptual relations, the linear form cannot be drawn in a 
straight line, as in Figure 1. Instead, a hyphen at the end of the first line indicates that the relations 
attached to [Go] are continued on subsequent lines. 

[Go]- 

(Agnt )-> [Person: John] 
(Dest) -> [City : Boston] 
(Inst) ->[Bus] . 

This example resembles frame notation, but LF also permits coreference labels to represent the cross 
references needed to represent arbitrary graphs. 

In the following CGIF representation for Figure 3, each concept has its own defining label: 

[Go: *x] [Person: John *y] [City: Boston *z] [Bus: *w] 
(Agnt ?x ?y) (Dest ?x ?z) (Inst ?x ?z) 

By nesting some of the concepts inside the relations, the CGIF form can be limited to just a single 
defining label *x and a bound label ?x inside each relation node: 

[Go *x] {Agnt ?x [Person: John]) (Dest ?x [City: Boston]) (Inst ?x [Bus]) 

The display form in Figure 3 represents the abstract CG most directly. All the variations of LF and CGIF 
represent different, but logically equivalent ways of linearizing the same abstract graph. 

The version of CGIF that assigns a separate defining label to each concept usually has the most direct 
mapping to KIF: 

(exists ((?x Go) (?y Person) (?z City) (?w Bus)) 
(and (Name ?y John) (Name ?z Boston) 

(Agnt ?x ?y) (Dest ?x ?z) (Inst ?x ?w) ) ) 
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Following is the corresponding formula in typed predicate calculus: 

{ 3x:Go) (By: Person) { 3 z: City) ( 3 w:Bus) 
(name (y, 1 John ' ) A name ( z, ' Boston ' ) A 
agnt(x,y) A dest (x, z) A inst(x,w)) 

For a list of the relations that connect the concepts corresponding to verbs to the concepts of their 
participants, see the web pagejon them atic ro les. 



4. A person is between a rock and a hard place. 

The between relation (Betw) is a triadic relation, whose first two arcs are linked to concepts of entities 
that occur on either side of the entity represented by the concept linked to the third arc. For a conceptual 
relation with n arcs, the first n-1 arcs have arrows that point toward the circle, and the n-th or last arc 
points away. 



Rock 



Person 




Hard 



In LF, Figure 4 may be represented in the following form: 

[Person] <- (Betw) - 

<-l- [Rock] 

<-2-[Place]->(Attr)->[Hard] . 

The hyphen after the relation indicates that its other arcs are continued on subsequent lines. The two arcs 
that point towards the relation are numbered 1 and 2. The arc that points away is the last or third arc; the 
number 3 may be omitted, since it is implied by the outward pointing arrow. For monadic relations, both 
the number 1 and the arrow pointing towards the circle are optional. For dyadic relations, the arcs are 
either numbered 1 and 2, or the first arc points towards the circle and the second arc points away. 

CGIF allows any number of concepts to be nested inside the relations: 

(Betw [Rock] [Place *x] [Person]) (Attr ?x [Hard]) 

For relations with more than 2 arcs, CGIF notation is more compact than the multiline LF notation. 
Therefore, most LF implementations allow CGIF notation to be mixed with the arrow notation: 

[Place: *x] -> (Attr ) -> [Hard] (Betw [Rock] ?x [Person]). 
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In the CG standard, the only notation that must be standardized is CGIF, since every implementation 
must recognize exactly the same forms. The LF and DF notations are specified only in an informative 
annex to the CG standard. Therefore, implementers may experiment with different variations in an 
attempt to improve readability or convenience. Nevertheless, too much variation may make it harder for 
human readers to switch from one version to another. 

Following is the KIF representation: 

{exists ( (?x person) (?y rock) (?z place) (?w hard)) 
(and (betw ?y ?z ?x) (attr ?z ?w) ) ) 

And following is the corresponding formula in predicate calculus: 

( 3x: Person) ( 3y:Rock) ( 3 z: Place) ( 3 w: Hard) 
(betw(y,z,x) A attr(z,w)) 

To emphasize the correspondence between CGs and KIF, it is possible to write CGIF in a form in which 
the concept nodes with their quantifiers and coreference labels precede the relation nodes: 

[Person *x] [Rock *y] [Place *z] [Hard *w] 
(betw ?y ?z ?x) (attr ?z ?w) 



5. Tom believes that Mary wants to marry a sailor. 

A context is a concept with a nested conceptual graph that describes the referent. In Figure 4, the 
concept of type Proposition is a context that describes a proposition that Tom believes. Inside that 
context is another context of type Situation, which describes a situation that Tom believes Mary wants. 
The resulting CG represents the sentence Tom believes that Mary wants to marry a sailor. 




In Figure 5, Tom is the experiencer (Expr) of the concept [Believe], which is linked by the theme 
relation (Thme) to a proposition that Tom believes. The proposition box contains another conceptual 
graph, which says that Mary is the experiencer of [Want], which has as theme a situation that Mary 
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hopes will come to pass. That situation is described by another nested graph, which says that Mary 
(represented by the concept [&top;]) marries a sailor. The dotted line, called a coreference link, shows 
that the concept [&top;] in the situation box refers to the same individual as the concept [Person: Mary] 
in the proposition box. Following is the corresponding linear form: 

[Person: Tom] <- (Expr ) <- [Believe] -> (Thme) - 

[Proposition: [Person: Mary *x] <- (Expr ) <- [Want ] -> (Thme ) - 
[Situation: [ ?x] <- (Agnt )<- [Marry] -> (Thme) -> [Sailor ] ] ] . 

Both the display form and the linear form follow the same rules for the scope of quantifiers. The part of 
the graph outside the nested contexts contains three concepts: [Person: Tom], [Believe], and the 
proposition that Tom believes. That part of the graph asserts information that is assumed to be true of 
the real world. 

Inside the proposition box are three more concepts: [Person: Mary], [Want], and the situation that Mary 
wants. Since those three are only asserted within the context of Tom's belief, the graph does not imply 
that they must exist in the real world. Since Mary is a named individual, one might give her the benefit 
of the doubt and assume that she also exists; but her desire and the situation she supposedly desires exist 
in the context of Tom's belief. If his belief is false, the referents of those concepts might not exist in the 
real world. Inside the context of the desired situation are the concepts [Marry] and [Sailor], whose 
referents exist within the scope of Mary's desire, which itself exists only within the scope of Tom's 
belief 

Following is the CGIF representation for Figure 5: 

[Person: *xl 'Tom'] [Believe *x2] (Expr ?x2 ?xl) 
(Thme ?x2 [Proposition: 

[Person: *x3 'Mary 1 ] [Want *x4] (Expr ?x4 ?x3) 
(Thme ?x4 [Situation: 

[Marry *x5] (Agnt ?x5 ?x3) (Thme ?x5 [Sailor]) ]) ]) 

Following is the KIF statement: 

{exists ((?xl person) (?x2 believe)) 
(and (expr ?x2 ?xl) 
(thme ?x2 

(exists ({?x3 person) (?x4 want) (?x8 situation)) 

(and (name ?x3 'Mary) (expr ?x4 ?x3) (thme ?x4 ?x8) 
(dscr ?x8 (exists ( (?x5 marry) (?x6 sailor)) 

(and (Agnt ?x5 ?x3) (Thme ?x5 ?x6) ))))))) ) 

Following is the predicate calculus formula: 

(3xl:Person) ( 3 x2 : Believe) (expr(xl,x2) A 

thme (x2, (3x3: Person) ( 3x4 : Want) ( 3 x8 : Situation) 

(name (x3, 'Mary 1 ) A expr(x4,x3) A thme(x4,x8) A 
dscr(x8, (3x5:Marry) (3x6:Sailor) 

(agnt(x5,x3) A thme (x5, x6) ) ) ) ) ) 

For further discussion of contexts and their representation in conceptual graphs and predicate calculus, 
see Chapter 5 of the book Knowledge Representation. 
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Copyright ©1999 by John F. Sowa. Anyone who is teaching or learning CGs or implementing tools that 
generate or interpret CGs is welcome to use these examples as illustrations or test cases. A license is 
hereby granted to anyone who would like to use the graphical images or the text-based representations in 
this document for any purpose, private or commercial, provided that the author and the URL of this 
document are cited in any publication that explains or accompanies such use. 




Ij Last Modified: 07/03/2001 23:13:33 
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A World of Conceptual Graphs 




Conceptual graphs (CGs) are a system of logic based on the existential graphs of Charles Sanders Peirce and 
the semantic networks of artificial intelligence. They express meaning in a form that is logically precise, humanly 
readable, and computationally tractable. With their direct mapping to language, conceptual graphs serve as an 
intermediate language for translating computer-oriented formalisms to and from natural languages. With their 
graphic representation, they serve as a readable, but formal design and specification language. CGs have been 
implemented in a variety of projects for information retrieval, database design, expert systems, and natural 
language processing. 

Introductions to Conceptual Graphs 



# Simon Polovina and John Heaton, "An Introduction to Conceptual Graphs," Al Expert, pp. 36-43, 1992. 

• John F. Sowa, Information Processing in Mind and Machine. Reading, MA: Addison-Wesley Publ., 1984. 

# John F. Sowa, "Conceptual Graphs Summary," in Conceptual Structures: Current Research and Practice, 
P. Eklund, T. Nagle, J. Nagle, and L. Gerholz, eds., Ellis Horwood, 1992, pp. 3-52. 

• John Sowa's brief summary . 

• John Sowa, Knowledge Representation : Logical, Philosophical, and Computational Foundations, is not 
limited to conceptual graphs, but provides broad coverage of the entire field. It is available from Barnes 
and Noble books, Amazon.com etc. 

# Aalborg University's Department of Communication has developed an excellent Online Conceptual 
Graphs course 



Conceptual Graphs Standard Notation 

At the moment, the standard is in draft form, but we expect the process to be completed in the next few months. 
In the meantime, a copy of the (nearly finalized) standard can be found below: 

For examples of conceptual graphs and their translations to predicate calculus and the Knowledge Interchange 
Format (KIF): 

• Examples using the standard HTML 4.0 symbol definitions 

i Examples using the symbols font in MS Windows (suitable for older versions of Navigator or Internet 
Explorer). 

For the draft proposed American National Standard for conceptual graphs: 

• CG dpANS using the standard HTML 4.0 symbol definitions 



http://www.cs.uah.edu/-delugach/CG/body.html 



1/5/05 



untitled 



Page 2 of 4 



# CG dpANS using the symbols font in MS Windows (suitable for older versions of Navigator or Internet 
Explorer) 

Conceptual Graph Bibliographies 



Bibliogr aphy from the CG standard 
John Sowa's bibli ography page 



Conceptual Graphs Conferences 



International Conference on Conceptual Structures 

13th International Conference on Conceptual Structures (ICCS 2005) 

July 18-22, 2005, Kassel. Germany. For information write to: stumme@cs.uni-kassel.de 

Previous conferences: 



12th International Conference on Conceptual Structures (ICCS 2004) 
July 19-23, 2004, Huntsville, Alabama, U.S.A. 

1 1th I nternational Co nference on Conceptual Structures (ICCS 2003) 
July 21-25, 2003, Dresden, Germany 

Tenth International Conference on Conceptual Structures (ICCS 2002) 
July 15- 19, 2002, Borovets, Bulgaria. 

Ninth International Conference on Conceptual Structures (ICCS 2001) 
July 30 - Aug. 3, 2001 , Palo Alto, California, U.S.A. 

Eighth International Conference on Conceptual Structures (ICCS 2000) 
August 14-18, 2000, Darmstadt, Germany 



Conceptual Graphs Email List 



An archive of the list messages (since September 2000) can be found at http://mars.virtual-earth.de/pipermail/cg/ 
(thanks to Mathias Picker) 

Harry Delugach, Conceptual Graphs Mailing List Administrator, delugach@cs.u ah.edu . 
To POST to the list, send mail to cg@cs.uah.edu (you must first join the list) 

To JOIN (receive the postings), send mail as follows or click here . Be sure the "From" email address is the one 
you want! 

To : ma j ordomo@ cs . uah . edu 
Subject: <ignored> 
subscribe eg 
end 

To UNSUBSCRIBE (get off the list), send mail as follows or click here . Be sure to include the exact email 
address which is currently subscribed. 



To: majordomo@cs.uah.edu 
Subject: <ignored> 

unsubscribe eg <your subscribed email address > 
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end 

Research Groups and Projects 

Universite Laval, Quebec City, Canada 
Cognitive I nformatics Laboratory 

Virginia Polytechnic and State University (Virginia Tech) 
Au tomatic Design Research Group 

Washington State University 

Conceptual Knowledge Markup Language Project 

Ont ology Links 

University of California, Santa Cruz 

Fast Co nceptual Graph Retrieval and Question Answering 

SIAD ■ 

Develo pment and use of CG tools 

in "knowledge base and expert systems, natural language processing, Case Based Reasoning and learning, 
Intelligent Tutoring Systems and Multi-Agent Systems. 

Aalborg University - Department of Communication 
Online Co nceptua l Graphs course 

Tools 

CharGer, a prototype conceptual graph editor developed the University of Alabama in Huntsville, free to 
noncommercial use, runs under Java 

Notio - an API specification for a set of Java classes designed to provide an implementation-independent 
interface for manipulating Conceptual Graphs, GNU license 

WebKB - tools for information retrieval and knowledge representation, availability?? 

CG M ars Lander - fast conceptual graph retrieval and question answering tool, available for joint development 
and industrial funding. 

Prolog+CG - an object-oriented extension of PROLOG, based on CG. CG (both simple and compound) is a basic 
data structure, like term. PROLOG+CG is implemented with Java 2. 

CoGITaNT - several useful utilities: a set of library routines in C++ for conceptual modeling, some knowledge 
bases in conceptual graphs, and an XML specification for CGXML. en francais. 

There's also an older list of Conceptual Graph Tools 

Individual Researchers 



Kalina Bontcheva 


University of 

Sheffield, 

UK 


Use of conceptual graphs for 
natural language generation 


kalina@dcs.shef.ac.uk 


http://www.dcs.shef.ac.uk/-kalina 




William C. Burkett 




Data Model Design and Quality, 
Database schema design 


wcb@usc.edu, 


wburkett@pdit.com 


Tru Hoang Cao 


Ho Chi Minh 
Univ. 

Technology, 
Vietnam 


Uncertain and imprecise 
knowledge representation 
and reasoning 


tru@dtt.hcmut.edu.vn 


http://www.dit.hcmut.edu.vn/-tru 
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Michel Chein 


LIRMM, 
Montpellier 


CORALI (Conceptual gRAph at 
Llrmm) 


chein@lirmm.fr 
http://www.lirmm.fr/~cogito 


Aldo de Moor 


Infolab, 
Til burg 
Univ., The 
Netherlands 


Application of conceptual graphs 
to information system 
specification 


http://infolab.kub.nl/people/ademoor 






delugach@cs.uah.edu 


Univ. 

Alabama in 

Huntsville, 

U.S.A. 


CGs in software requirements 
CGs in knowledge acquisition 


http://www.cs.uah.edu/-delugach 


Harry Delugach 




Bob Levinson 
Gil Fuchs 


Univ. 

California, 
Santa Cruz, 
U.S.A. 


Fast conceptual graph retrieval 
and question answering 




Vladimir N. Polyakov 




Natural language processing 


. . /0 ... .. n . 
http://www.geocities.com/oiiiconvaiiey/ 


Campus/7926/Polyakov/Polyakov.htm 


John F. Sowa 


U.S.A. 


Knowledge representation and 
natural language semantics 


http://www.bestweb.net/-sowa/direct 






David Cox 


U.S.A. 


Explanation by pattern: FLIPP 


http://www.flipp-explainers.org 



(if you'd like to be listed here, please notify the maintainer delugach@cs.uah.edu ) 



This page maintained by delugach@cs.uah.edu and was last changed on November 4, 2004 . 
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